Automated Essay Scoring Effect on Test Equating Errors in Mixed-format Test
نویسندگان
چکیده
Scoring constructed-response items can be highly difficult, time-consuming, and costly in practice. Improvements computer technology have enabled automated scoring of items. However, the application without an investigation test equating lead to serious problems. The goal this study was score mixed-format tests automatically with different test/training data rates investigate indirect effect these scores on compared human raters. Bidirectional long-short term memory (BLSTM) selected as method for best performance. During process, methods based classical theory item response were utilized. In most methods, errors resulting from close occurring processes conducted by It concluded that applied because it is convenient terms equating.
منابع مشابه
the relationship between eq, iq and test format: a study on test fairness
the major aim of this study was to investigate the relationship between iq, eq and test format in the light of test fairness considerations. this study took this relationship into account to see if people with different eq and iq performed differently on different test formats. to this end, 90 advanced learners of english form college of ferdowsi university of mashhad were chosen. they were ask...
15 صفحه اولPractical Consequences of Item Response Theory Model Misfit in the Context of Test Equating with Mixed-Format Test Data
In item response theory (IRT) models, assessing model-data fit is an essential step in IRT calibration. While no general agreement has ever been reached on the best methods or approaches to use for detecting misfit, perhaps the more important comment based upon the research findings is that rarely does the research evaluate IRT misfit by focusing on the practical consequences of misfit. The stu...
متن کاملConsidering Misconceptions in Automatic Essay Scoring with A-TEST - Amrita Test Evaluation and Scoring Tool
In large classrooms with limited teacher time, there is a need for automatic evaluation of text answers and real-time personalized feedback during the learning process. In this paper, we discuss Amrita Test Evaluation & Scoring Tool (A-TEST), a text evaluation and scoring tool that learns from course materials and from human-rater scored text answers and also directly from teacher input. We use...
متن کاملBeyond Automated Essay Scoring
The ability to communicate in natural language has long been considered a defining characteristic of human intelligence. Furthermore, we hold our ability to express ideas in writing as a pinnacle of this uniquely human language facility—it defies formulaic or algorithmic specification. So it comes as no surprise that attempts to devise computer programs that evaluate writing are often met with ...
متن کاملAutomated Essay Scoring for Swedish
We present the first system developed for automated grading of high school essays written in Swedish. The system uses standard text quality indicators and is able to compare vocabulary and grammar to large reference corpora of blog posts and newspaper articles. The system is evaluated on a corpus of 1 702 essays, each graded independently by the student’s own teacher and also in a blind re-grad...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Assessment Tools in Education
سال: 2021
ISSN: ['2148-7456']
DOI: https://doi.org/10.21449/ijate.815961